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1.  Introduction 

Intelligent  systems  for  decision  support  are  computer 
implemented  procedures  that  seek  to  combine  expert  knowledge 
about  a  domain  with  expert  methods  of  conceptualizing  and 
reasoning  about  that  domain.  They  Integrate  this  with  "formal" 
methods  of  reasoning  about  the  domain.  The  inferential  power  of 
ouch  computer  programs  rests  upon  a  knowledge  base  that  puts 
together  factual  information  about  the  domain  with  the  heuristics 
or  informal  "rules  of  thumb"  experts  use  to  rapidly  find 
solutions  to  problems  and  with  the  formal  reasoning  methods  that 
are  needed  when  approaching  an  unstructured  problem  about  which 
experiential  familiarity  is  slight. 

The  goal  of  an  intelligent  system  for  decision  support  is  to 
encode  in  a  computer  program  the  facts  an  expert  has  and  th' 
methods  of  reasoning  about  them,  together  with  formal  method 
reasoning  about  unstructured  situations.  In  that  sense,  an 
intelligent  system  may  be  viewed  as  a  descriptive  model  of  an 
expert  reasoning  process  about  a  problem  domain  and  a  normative 
system  to  aid  in  formal  reasoning  when  this  expertise  does  not 
exist.  Although  intelligence  support  systems  have  the  potential 
of  encoding  cognitive  biases  or  prejudice,  they  may  be  very 
attractive  to  planners  and  decision  makers  because  they  could  be 
set  up  as  on-line  decision  support  systems  in  situations  where 
time  limitations  are  an  Important  factor.  There  are  methods, 
currently  under  investigation,  that  enable  detection  of 
inconsistent  reasoning  and  it  is  hoped  that  such  efforts  may  be 
extended  to  enable  detection  of,  at  least  some,  of  the  identified 
cognitive  biases  associated  with  human  information  processing. 


2.  Knowledge  Representation  and  Processing  in  Decision  Support  ft 
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knowledge  bases  have  been  the  subject  of  Investigation  for  many  ^ 
researchers  An  appropriate  representation  can  be  used  tc  U 
describe  the  four  different  types  of  factual  knowledge  elements  ~ 
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of  the  values  that  need  to  be  associated  with  facts  In  order  to 
enable  judgment  and  choice.  The  purpose  of  a  particular 
knowledge  representation  Is  to  enable  the  use  of  knowledge  for: 
retrieving  factual  Information  from  the  knowledge  base  that  is 
judged  relevant  to  the  task  at  hand,  reasoning  about  these  facts 
In  the  search  for  a  resolution  of  the  task  requirements,  and 
acquiring  more  knowledge.  Several  approaches  for  the 
representation  of  knowledge  as  they  apply  to  the  control  and 
generation  of  dialogue  for  human-system  interaction  are  discussed 
in  Sage  and  Lagomasino  [1984]. 

2.1  Knowledge  Base  Management  System  [KBMS] 

A  knowledge  base  management  system  Is  one  of  the  three 
fundamental  components  of  an  Intelligent  system  for  decision 
support.  In  almost  every  Instance  In  which  there  will  exist 
multiple  decisionmakers,  there  will  exist  the  need  for  Individual 
knowledge  bases  and  organizational  knowledge  bases.  Some  of  the 
desirable  characteristics  of  a  DBMS  Include  the  ability  to  cope 
with  a  variety  of  data  structures  that  allow  for  probabilistic. 
Incomplete,  Imprecise,  and  other  forms  of  Imperfect  data;  and 
data  that  Is  unofficial,  and  personal,  as  contrasted  with 
official  and  organizational. 

In  order  to  construct  a  knowledge  base,  it  Is  first 
necessary  to  identify  a  knowledge  representation  scheme.  A 
representation  scheme  Is  a  collection  of  data  structures, 
operations  that  may  be  applied  on  the  data  structures,  and 
Integrity  rules  which  are  use  to  constrain  or  otherwise  define 
permissible  values  of  the  data.  There  are  at  least  five  models 
that  may  be  used  to  represent  data.  The  most  elementary  of  these 
is  the  individual  record  model.  The  relational  model  is  a 
powerful  generalization  of  the  record  model.  A  relation  is  the 
fundamental  data  structure  in  the  relational  model,  and  there  may 
be  a  number  of  fields  In  any  given  relation.  The  relational 
model  enables  mathematical  set  operations  in  terms  of  addition  of 
new  records,  updating  fields  within  existing  records,  creating 
relations  that  may  be  contained  In  records,  deleting  relations 
that  may  be  contained  in  records,  joining  or  combining  two  or 
more  relations  based  on  their  containing  common  fields,  selecting 


records  by  virtue  of  their  containing  certain  specified 
relations,  and  projection  such  as  to  enable  selection  of  a  subset 
of  the  fields  that  exist  in  a  relation. 

The  hierarchical  or  tree  data  model  is  a  relatively 
efficient  representation  of  data.  In  a  hierarchical  model,  the 
structure  represents  the  information  that  is  contained  in  the 
fields  of  a  relational  model.  In  a  hierarchical  model,  there 
will  be  certain  records  which  must  exist  before  other  records  can 
exist  since  every  data  structure  must  have  a  root  record. 
Because  of  this  structured  aspect  of  the  model,  it  will  be 
necessary  to  repeat  some  of  the  data  that  need  be  stored  only 
once  for  a  relational  model.  The  network  model  is  a 
generalization  of  the  hierarchical  model  in  that  there  are  links 
between  records  which  enables  a  given  record  to  participate  in 
several  relationships.  There  are  often  major  problems  associated 
with  Insertions,  deletions,  and  updating  in  both  the  hierarchical 
and  network  data  models  due  to  the  need  to  maintain  a  consistent 
data  base.  These  do  not  exist  in  the  relational  model  since  the 
same  data  is  never  entered  more  than  once.  Also  there  is 
additional  search  complexity  since  a  search  can  start  anywhere  in 
the  network  structure.  Searches  are,  however,  generally  more 
efficient  than  they  are  in  the  relational  model. 

Due  to  the  need  to  accommodate  Intelligent  capabilities  in  a 
decision  support  system,  it  is  desirable  to  consider  a  production 
rule  model  as  a  fifth  data  model.  This  will  enable  Inferences  to 
be  made.  Thus  this  is  a  particularly  desirable  form  of  data 
model  when  we  desire  to  use  many  predictive  management 
information  system  capabilities.  The  "if  then"  type  response  to 
"what  if"  queries  is  especially  natural  in  this  representation. 
As  will  be  shown,  this  representation  allows  for  efficient  meta¬ 
level  control,  through  decision  support  type  approaches,  of  the 
production  rules  in  an  expert  system  knowledge  base. 
Knowledge  representation  formats  also  Include  frame,  script,  and 
schema  representations.  These  representations  are  much  like  the 
cognitive  maps  that  humans  construct  of  the  world  around  them. 
At  this  point,  there  does  not  seem  to  exist  operational  data 
models  based  on  these  representations,  and  surely  this  is  an  area 
of  contemporary  research  need.  Additional  discussion  of  data 


base  management  management  system  [DBMS]  design  approaches  can  be 
found  In  Sprague  and  Carlson  [1982],  and  Date  [1977,  1983].  The 
three  volume  Handbook  of  Artificial  Intelligence  edited  by  Barr, 
Cohen  and  Felgenbaum  [1981,1982]  and  the  text  by  Sows  [1984] 
discuss  knowledge  representation  from  an  AI  perspective. 

2.2  Model  Base  Management  System  [ MBMS ] 

It  is  necessary  to  provide  Inference  capability  in  an 
intelligent  system.  This  requires  some  sort  of  model  base 
management  system  [MBMS].  It  is  through  the  use  of  model  base 
management  systems  that  we  are  able  to  provide  for  sophisticated 
analysis  and  Interpretation  capability  in  a  decision  support 
system.  The  single  most  important  characteristic  of  a  model  base 
management  system  is  that  it  should  enable  the  decisionmaker  to 
explore  the  decision  situation  through  use  of  the  knowledge  base 
by  a  model  base  or  algorithmic  procedures  and  management 
protocols.  This  can  occur  through  the  use  of  modeling 
statements,  in  some  procedural  or  nonprocedural  language,  through 
the  use  of  the  model  subroutines,  such  as  mathematical 
programming  packages,  that  are  called  by  a  management  function, 
and  through  the  use  of  data  abstraction  models.  This  approach 
facilitates  updating  and  use  of  the  model  for  explanatory  and 
explication  purposes. 

The  use  of  multiple  models  can  potentially  accommodate  the 
desire  of  the  typical  decisionmaker  for  flexibility.  Thus  a 
mixed  scanning  approach  might  be  Incorporated  in  which  a 
conjunctive  or  disjunctive  scanning  mechanism  is  used  to  allow 
for  an  individual  scan  to  eliminate  grossly  unacceptable 
alternatives.  After  this  is  accompl ished,  further  evaluation  of 
alternatives  might  be  accomplished  by  a  compensatory  tradeoff 
evaluation,  or  one  based  on  a  dominance  search  procedure  [Sage 
and  White,  1984]. 

To  provide  flexibility,  the  MBMS  should  provide,  upon  system 
user  request,  a  variety  of  prestructured  models  that  have  been 
found  useful  in  the  past,  such  as  linear  programming  and 
multiattribute  decision  analysis  model,  and  procedures  to  use 
these  models.  It  should  also  allow  for  the  development  of  user 
built  models  and  heuristics  that  are  developed  from  established 


models  that  will  either  become  permanent  parts  of  the  MBMS  or 
which  will  be  considered  as  ad  hoc  models.  It  should  also  be 
possible  to  perform  sensitivity  tests  of  model  outputs,  and  to 
run  models  with  a  range  of  data  to  obtain  the  response  to  a 
variety  of  what  If  type  questions. 

2.3  Dialogue  Generation  and  Management  System  [DGMS] 

The  dialogue  generation  and  management  system  portion  of  a 
decision  support  system  is  designed  to  satisfy  knowledge 
representation,  and  control  and  Interface  requirements  of  the 
Intelligent  system  for  decision  support.  It  Is  the  DGMS  that  Is 
responsible  for  presentation  of  the  outputs  of  the  system  to  the 
decisionmaker  and  for  determining,  acquiring,  and  transmitting 
their  inputs  to  the  KBMS  and  the  MBMS  based  on  Its  knowledge 
about  the  decisionmaker's  goals  about  the  specific  decision 
situation.  Thus  the  DGMS  is  responsible  for  producing  output 
representations,  for  obtaining  the  decisionmaker  inputs  that 
result  In  the  operations  on  the  representations,  for  Interfacing 
to  the  memory  aids,  and  for  explicit  provision  of  the  control 
mechanism  that  enable  effective  dialogue  between  the  user  and  the 
KBMS  and  MBMS. 

There  are  a  number  of  possible  dialogues.  These  are 
inherently  linked  to  the  representational  forms  that  are  used  for 
the  DBMS  and  MBMS.  Menus,  spreadsheets,  tradeoff  graphs,  and 
production  rules  are  some  of  the  formats  that  may  be  used  as  a 
basis  for  dialogue  system  design.  Generally,  several  of  these 
should  be  used  as  the  support  system  user  may  wish  to  shift  among 
these  formats  as  the  nature  of  issues  and  experiential 
familiarity  with  the  issues  changes.  The  DGMS  should  be 
sufficiently  flexible  such  as  to  allow  review  and  sensitivity 
analysis  of  past  Judgments,  and  to  provide  partial  Judgments 
based  upon  incomplete  information.  Of  course,  the  DGMS  should  be 
"user  friendly"  through  provision  of  various  KELP  facilities, 
prompting  the  decisionmaker,  and  other  abilities  that  supports 
the  knowledge  of  the  support  system  user. 


3.  Management  of  Intelligent  Systems 

Limits  associated  with  the  cognitive  capacity  of  the  human 
mind,  time  limitations,  and  many  other  competing  concerns  of  the 
decisionmaker  are  constraints  that  affect  adequate  formulation, 
analysis,  and  interpretation  of  complex  large  scale  Issues.  A 
design  goal  for  intelligent  systems  and  processes  that  will 
in  various  problem  solving  tasks  is  to  reduce,  to  the 
extent  possible,  the  effects  of  the  aforementioned  constraints  so 
as  to  enable  the  efficient  and  effective  use  of  information  that 
will  lead  to  quality  judgments  in  routine  and  familiar  task 
environments  and  In  unfamiliar  task  conditions. 

An  appropriate  framework  In  which  knowledge  could  be 
organized  and  utilized  efficiently  and  effectively  Is  desired. 
This  is  especially  needed  as  studies  have  shown  that  the  way  in 
which  a  task  Is  framed  exerts  a  very  strong  Influence  upon  the 
way  In  which  task  requirements  and  task  resolution  efforts  are 
determined  [Kahneman,  Slovlc  and  Tversky,  1982;  Sage,  1981].  This 
requires  that  we  be  able  to  address  the  modeling  of  Intelligent 
systems  for  decision  support  from  several  perspectives.  Our 
Interest  here  is  to  describe  implications  that  arise  In  the 
design  of  Intelligent  systems  for  decision  support  that 
Incorporates  systems  management  activities.  Of  particular 
Interest  will  be  those  components  at  the  Interface  between  the 
cognitive  process  level  of  systems  management  and  the  problem 
level,  and  at  the  knowledge  metalevel  which  will  enable  effective 
modeling  of  the  intelligent  system  itseir. 

3.1  The  Problem  Level 

At  the  problem  level  in  the  systems  management  process, 
there  are  a  number  of  abilities  that  an  intelligent  system  for 
decision  support  should  have.  It  should  assist  the  decisionmaker 
in  the  formulation  or  framing  of  the  decision  situation  in  the 
sense  of  recognizing  needs,  identifying  appropriate  objectives  by 
which  to  measure  the  successful  resolution  of  an  issue,  and 
generating  alternative  courses  of  action  that  will  resolve  the 
needs  and  satisfy  objectives.  It  should  also  provide  support  in 
enhancing  the  abilities  of  the  decisionmaker  to  obtain  the 
possible  impacts  on  needs  of  the  alternative  courses  of  action. 


and  to  understand  systems  behavior.  This  analysis  capability  must 
be  associated  with  provision  of  capability  to  study  the  response 
or  changes  In  the  existing  situation  due  to  potential 
intervention  as  to  enhance  the  ability  of  the  decisionmaker  to 
provide  an  Interpretation  of  these  impacts  in  terms  of  predefined 
and  evolving  objective  measures.  This  interpretation  capability 
will  lead  to  evaluation  of  the  alternatives  and  selection  of  a 
preferred  alternative  option.  Associated  with  these  must  be  the 
ability  to  acquire,  represent,  and  utilize  information  or 
knowledge,  and  the  ability  to  Implement  the  chosen  alternative 
courses  of  action.  All  of  this  must  be  accomplished  with  due 
consideration  with  the  particular  rationality  perspective  that  Is 
used  for  decisionmaking. 

3.2  Cognitive  Process  Level 

Several  Intelligent  systems  design  complexities  arise  at  the 
cognitive  process  level  of  systems  management.  These  relate  to 
the  forms,  frames,  or  perspectives  associated  with  acquiring. 
Integrating,  and  applying  vast  amounts  of  knowledge.  These  forms 
range  from  the  systemic  framework  of  formulation,  analysis,  and 
Interpretation  at  the  problem  level  that  Is  characteristic  of 
formal  operational  or  holistic  thought,  to  Intuitive  affect  that 
is  characteristic  of  concrete  operational  and  whollstic  thought. 
The  reasoning  perspectives  Invoked  at  the  cognitive  process  level 
of  problem  resolution  depend  upon  the  task  requirements,  the 
experiential  familiarity  of  the  decisionmaker  with  the  task,  and 
the  rationality  perspectives  that  are  used  for  task  resolution 
[Sage,  1981,  1982;  Llnstone,  1984]. 

4.  Knowledge  Aggregation  Needs  in  Intelligent  Systems  for 

Decision  Support 

Various  assumptions  about  the  nature  and  characteristic  of 
the  contingency  structural  elements  of  task,  environment,  and 
human  problem  solver  familiarity  with  these  are  considered 
essential  In  the  design  of  Intelligent  systems  in  order  to  enable 
effective  and  efficient  organization  of  knowledge  about  specific 
situation  domains.  Due  to  these  assumptions,  not  all  specific 
domains  of  knowledge  are  suitable  for  building  Intelligent 


systems  for  decision  support.  Gevarter  [1984]  Identifies  several 
characteristics  that  a  domain  of  knowledge  must  satisfies  at  the 
knowledge  level  in  order  to  allow  an  intelligent  system  to  be 
built  that  is  based  only  on  expert  knowledge: 

(1)  There  must  be  at  least  one  human  expert  who  is 
acknowledged  to  perform  the  task  well. 

(?)  T*e  primary  sources  of  the  eyp* rt'e  abilities  must  be 
special  knowledge,  judgment,  and  experience. 

(3)  The  expert  must  be  able  to  articulate  that  special 
knowledge,  judgment,  and  experience  and  also  explain 
the  methods  used  to  apply  it  to  a  particular  task. 

(4)  The  task  must  have  a  well-bounded  domain  of  application. 
There  will  exist  many  situations  In  which  these  requisite 
conditions  are  not  satisfied.  A  decision  support  system  Is  a 
generic  dual  of  an  expert  system  and  Is  intended  for  use  in 
situations  where  at  least  one  of  the  aforementioned  four 
conditions  do  not  apply.  It  appears  that  this  will  often  occur. 
For  this  reason  there  Is  motivation  to  seek  support  system  design 
incorporating  features  of  both  the  expert  system,  whose  design 
assumes  availability  of  relevant  expertise,  and  the  decision 
support  system,  the  design  of  which  assumes  that  this  expert 
knowledge,  and  Its  availability  in  a  well  structured  format, 
cannot  be  assumed. 

The  representation  of  knowledge  suggests  the  existence  of 
some  form  of  prior  knowledge  which  enables  the  system  to  perform 
the  function  of  acquisition  and  aggregation  of  the  new  knowledge 
in  with  the  existing  knowledge  as  to  enable  decision  support. 
This  much  be  such  as  to  enable  expansion,  contraction, 
replacement,  and  residual  shifts  with  respect  to  knowledge  in  the 
knowledge  base.  Also,  notions  of  knowledge  "quality"  need  to  be 
associated  with  various  knowledge  representations  and  updated  as 
new  knowledge  is  received. 

Information  seeking  efforts  are  necessarily  concerned  with 
the  process  by  which  information  that  is  relevant  to  a  situation 
is  obtained  from  the  environment.  A  knowledge  representation 
system  must  be  able  to  provide  a  description  and  an  explanation 
of  the  situation  such  as  to  enable  generation  of  a  set  of  belief 
or  knowledge,  organized  into  a  "representation,"  about  the 


situation.  It  should  be  noted  that  what  aay  be  a  belief  to  one 
person  aay  be  knowledge  to  another  [Abelson,  1979]  and  this 
relates  to  perceived  inforaatlon  quality. 

There  aust  be  also  a  generalization  component,  or  inference 
aechanlsa  that  Is  equipped  with  soae  fora  of  basic  logic  to 
enable  access  to  the  knowledge  base  for  foraatlon  of  Inference 
and  ^ludoaents.  A  fundamental  question  arises  from  this  discussion 
concerning  how  a  priori  knowledge  and  the  generalization 
component  Influence  the  operation  of  the  complete  Intelligent 
system  for  decision  support. 

There  are  two  perspectives  that  are  relevant  here  concerning 
how  individuals  go  about  the  retrieval  of  Information,  the  use  of 
information  for  reasoning,  and  the  feedback  process  that  enables 
acquisition  of  new  knowledge.  One  perspective  concerning  this  Is 
that  learning  Is  performed  by  an  elementary-to-complex  process  in 
which  simple  things  are  learned  first  and  from  this,  more 
advanced  concepts  are  then  learned.  The  other  perspective  is 
based  on  the  belief  that  learning  starts  with  complex  statements 
about  the  description  of  a  situation;  and  that  through 
decomposition  Into  simpler  statements  a  system  Is  able  to 
Increase  Its  understanding  concerning  the  specific  situation 
domain. 

As  a  means  of  illustrating  the  two  perspectives  concerning 
the  knowledge  acquisition  process,  It  is  useful  to  compare 
problem  solving  activities  and  natural  language  understanding  in 
some  detail  with  respect  to  this  two  perspectives  concerning 
learning  or  acquisition  of  new  knowledge. 

Most  artificial  intelligence  systems  that  are  In  use  today 
are  based  on  the  first  perspective  with  respect  to  acquisition 
and  aggregation  of  new  knowledge.  They  use  the  elementary-to- 
complex  perspective  and  do  not  typically  verify,  validate,  or 
otherwise  seek  to  determine  the  consistency  of  the  resulting 
knowledge  base.  The  resulting  lack  of  control  with  respect  to 
questions  of  validity  of  the  resulting  knowledge  base  is 
characteristic  of  an  Incomplete  intelligent  system.  If  this 
perspective  of  knowledge  acquisition  and  aggregation  is  used 
exclusively,  then  some  essential  components  of  an  intelligent 
system  have  been  omitted,  or  the  Interaction  between  the  support 


system  and  the  user  has  been  modeled  Inadequately. 

Systems  that  operate  at  the  other  extreme  of  the  knowledge 
acquisition  spectrum,  such  that  learning  proceeds  in  a  complex- 
to-elementary  fashion,  have  been  difficult  to  Implement.  Zn 
reality,  both  modes  of  learning  are  appropriate  and  both  are  used 
by  the  human  problem  solver.  Integration  of  the  two  approaches  is 
clearly  desirable  and  this  is  a  major  concern  of  this  paper. 

5  Inferential  Support  for  Knowledge  Aggregation 

Inferential  activities  based  on  imprecise.  Incomplete, 
inconsistent,  or  otherwise  imperfect  knowledge  is  becoming  more 
important  in  the  design,  implementation,  and  operation  of  expert 
systems.  Inference  is  concerned  with  the  generation  of  theories 
and  hypotheses  beyond  those  originally  given.  In  planning  and 
decisionmaking  activities  the  Information  that  is  usually 
available  initially  is  limited  as  to  allow  satisfactory 
performance  of  judgment  and  choice.  Hence,  inference  is  an 
essential  activity  for  systems  intended  to  aid  in  the  learning 
process . 

Several  approaches  for  making  Inference  from  available 
information  have  been  developed  ranging  from  strict  probabilistic 
Bayesian  reasoning  to  less  mathematically  rigorous  approaches. 
Analysis  of  systems  based  on  these  methods  reveals  discrepancies 
on  the  results  obtained  due  largely  to  the  differences  in  the 
underlying  assumptions  in  which  they  are  based.  Quinlan  [1963] 
contrasts  several  of  these  approaches  and  classifies  their 
dissimilarities  in  terms  of: 

(1)  the  way  in  which  the  uncertain  Information  about 
propositions  is  represented, 

(2)  the  assumptions  that  form  the  basis  for  propagating 
information, 

(3)  the  control  structure  used  for  this  propagation,  and 

(4)  the  treatment  of  inconsistent  information. 

Sage  and  Botta  [1983]  also  present  a  summary  of  contemporary 
research  Involving  Inference  mechanisms  in  expert  systems, 
concentrating  on  the  extent  to  which  these  mechanisms  can  be 
Bayesian. 

Most  of  the  existing  research  concerning  inference  uses 


probability  theory  as  the  standard  for  the  representation, 
aggregation,  and  Interpretation  of  Information.  However,  while 
such  theories  have  the  advantage  of  modeling  the  uncertainties 
and  present  in  human  discourse,  there  are  at  least  two  potential 
difficulties.  The  semantic  correspondence  of  probabilistic  type 
expressions  to  natural  language  expressions  Is  questionable  In 
occasions.  Also,  there  are  other  forms  of  Information 
Imperfections  than  "uncertainties"  and  the  probabilistic 
representation  of  these  other  forms,  while  often  possible.  Is 
sometimes  cumbersome  at  beat. 

A  large  number  of  studies  In  cognitive  psychology  Indicate 
that  human  judgments  of  probability  values  are  often  Inconsistent 
with  the  simple  axioms  of  probability.  A  comprehensive  review  of 
these  efforts  can  be  found  In  Sage  [1981].  Often,  these  errors 
are  of  considerable  magnitude  and  not  just  small  deviations 
usually  expected  from  Intuitive,  subjective  assessments.  Failure 
to  follow  the  rules  of  probability  are  generally  attributed  to 
errors  of  application  and  errors  of  comprehension  of  such  rules. 
An  error  of  application  exists  If  there  Is  evidence  that  people 
know  and  accept  a  rule  that  they  did  not  apply.  If  people  do  m 
recognize  the  validity  of  the  rule  they  violated.  It  Is  called  an 
error  of  comprehension.  Since  both  types  of  errors  are  described 
In  terms  of  violations  to  the  rules  of  probability,  we  could  as 
well  claim  that  the  errors  are  the  result  of  a  misrepresentation 
of  human  judgments  about  uncertainty.  An  error  of  representation 
refers  to  the  semantic  correspondence  between  the  natural 
language  expression  and  the  symbolic  representation  and  rules  of 
aggregation  used  for  Inference.  Errors  of  representation  may 
result  on  a  set  of  Inconsistent  hypotheses.  So,  an  Inferential 
inconsistency  may  Indicate  an  error  In  representation  but  the 
contrary  Is  not  true,  l.e.,  agreement  does  not  necessarily 
reflect  understanding  of  semantic  principles.  Consequently, 
questions  arise  concerning  how  to  detect  and  avoid  errors  of 
representation  and  which  framework  to  use  in  modeling 
uncertainty.  Imprecision,  and  potentially  other  forms  of 
Information  imperfection  as  well. 

Inferential  activities  based  on  logical  interconnection  of 
elements  in  a  hierarchical  net  or  tree  are  called  hierarchical 


Inference.  Hierarchical  Inference  usually  entails  a  series  of 
Inversion,  aggregation  and  cascading  processes  to  compute  the 
likelihood  of  an  underlying  hypotheses  and  observable  evidences 
based  on  their  logical  relations.  Inversion  Involves  reversing 
the  logical  relation  among  elements  in  the  network  In  order  to 
calculate  more  easily  the  desired  relation.  In  a  Bayesian  model, 
the  process  of  inversion  Is  represented  by  Bayes  theorem.  When  e 
datum  D  Is  perceived  to  have  an  impact  on  the  occurrence  of  an 
event  H,  the  relation  between  D  and  H  Is  given  by 

P(H) 

P(H|D)  - -  P(D | H) 

P(D) 

so  the  perceived  effect  of  the  likelihood  of  H  given  D  Is 
expressed  in  terms  of  the  perceived  effect  of  the  likelihood  of  D 
given  H.  Aggregation  Is  the  task  of  assessing  the  impact  of  a  set 
of  data  on  a  given  hypotheses  based  on  the  immediate  logical 
relations  between  the  data  {D^.D*,...  }  and  the  hypotheses  H. 
Symbolically  we  have  P(H  |  D1  ,D2  , . ..  )  «  R[P(H  ID1)  ,P(H  |D2)...  ] 
where  R  Is  the  function  that  aggregates  the  local  relations 
P(H | D1)  to  form  the  global  relation  PfHID^D2,...  ).  Cascading  Is 
the  combination  of  a  series  of  Immediate  relations  on  a  chain  of 
sequential  Impacts  to  assess  a  global  relation.  For  example.  If  a 
datum  D  Is  perceived  to  have  an  effect  on  an  event  E  and  this  In 
turn  effects  H(D->E->H),  then  the  process  of  cascading  consists 
in  calculating  P(H|D)  based  on  the  local  relations  P(H|E)  and 
P(E|D) . 

The  general  case  of  hierarchical  inference  Involves  a  number 
of  processes  of  Inversion,  aggregation  and  cascading.  A  node  in 
the  hierarchical  Inference  net  represents  a  finite  partition  of 
exclusive  and  exhaustive  possible  states.  It  may  be  a  set  of 
hypotheses,  a  set  of  observable  or  unobservable  events,  or  more 
generally  just  data. 

The  Impact  of  a  given  state  Dj  on  a  state  Aj  Is  given  by 
Bayes  Inversion  theorem  as 


(1) 


P«Aj) 

p(Aj|Dl)  s  -  p(°i  I  Aj)  (1) 

P(Di) 

Conditioning  on  the  states  of  the  intermediate  node  B  to 
calculate  PtDjjAj)  and  then  inverting  and  cascading  the  result 
gives  us 


LvinCkV 


^(DilAj 


p(Aj|Di)  = - ^PCDilAj  Bk)  P(Bk|Aj)  (2) 

P(Di)  k-1 

In  decomposition  for  cascading,  it  is  usually  assumed  that  the 
relation  among  the  states  of  adjacent  nodes  is  unaffected  by  the 
occurrence  of  states  at  other  nodes.  In  this  case,  the  likelihood 
of  state  given  that  Bk  occurred  is  independent  of  every  state 
A j  so  P(Dj  |AjBk)=P(Dj  |Bk)  and  Eq  (2)  becomes  for  the  chain  of 


nodes  A->C->E 


?{ A j i E’  )  =  P(A.j) 


■P^ltlEi)  P(  Ck  J  A  j  ) 


P(Ck) 


Equation  (3)  is  sometimes  referred  to  as  the  "Modified  Bayes 
Theorem"  [Gettys  and  Willke,  1969]  and  has  been  used  in  a  class 
of  procedures  called  "probabilistic  information  processing" 
[Edwards  et.  al.,  1968]  to  help  people  overcome  the  suboptimum 
behavior  they  show  when  revising  probabilities  of  interrelated 
events.  Use  of  this  equation  requires  the  assessment  of  large 
amounts  of  data  that  may  be  very  difficult  to  assess  intuitively 
in  complex  hierarchical  inference  structures.  For  example,  the 
meaning  of  the  likelihood  or  probability  of  a  new  state  given  all 
previous  information  is  difficult  to  understand  when  it  comprise 
the  conjunction  of  a  large  number  of  states.  In  addition,  the 
complexity  in  the  processing,  storing  and  assessment  steps 
increases  rapidly  with  the  number  of  nodes  in  the  network.  This 
has  led  to  the  common  criticism  of  using  a  formal  Bayesian 
framework  for  inference  [Kelly  and  Barclay,  1973].  Recent  work, 
especially  that  by  Pearl  [1982ab,  1983]  indicates  that  this 
criticism  may  not  be  fully  justified. 
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An  interesting,  efficient  scheme  for  the  propagation  of 
beliefs  or  evidence  in  hierarchically  organized  inference 
structures  has  been  recently  reported  by  Pearl  [1982ab].  The 
scheme  relies  in  decomposing  an  inference  task  into  a  series  of 
simpler  intuitive  inferences  linking  each  stage  in  the  hierarchy 
to  produce  a  global  assessment.  The  computation  of  the  global 
assessment  is  simplified  by  reformulating  the  general  Bayesian 
procedure  for  hierarchically  organized  inference  structures 
discussed  here.  Data  can  be  communicated  among  adjacent  nodes, 
and  used  to  update  the  information  at  every  node  throughout  the 
network.  The  decomposed  Bayesian  processing,  characteristic  of 
this  scheme,  allows  updating  to  be  performed  by  a  series  of  local 
updating  processes  between  each  node  and  its  neighbors,  rather 
than  by  a  central  processing  as  in  the  general  Bayesian 
framework.  The  likelihood  of  the  various  states  of  a  given  node 
depend  on  the  entire  data  observed.  Hence,  the  impact  of  the 
entire  data  on  a  given  node  can  be  decomposed  in  two  disjoint 
sets  of  data:  that  obtained  from  the  network  rooted  at  that  node 
and  data  from  the  network  above  the  node.  At  node  A  let  Dd(A) 
stand  for  data  obtained  from  the  network  rooted  at  A,  i.e.,  nodes 

B1 . Bl  and  nodes  in  the  networks  rooted  on  these;  and  let 

Du( A)  be  data  obtained  from  nodes  in  the  network  above  A,  i.e.,  B 
and  nodes  above  it,  A1,...,AM  and  nodes  rooted  on  these.  This 
decomposition  prescribes  how  Information  obtained  from  above  and 
below  some  node  should  be  combined.  A  series  of  manipulations 
leads  to 

PfA^  -  a  g(Ai)  q(Ai)  (4) 

where  g{  A*  )«P(Dd(  A)  |  A* )  represents  the  probabilistic  support 
attributed  to  AA  by  the  nodes  below  it,  q ( A * ) =P ( Aj | Du ( A )  ) 
represents  the  probabilistic  support  received  by  A^  from  the 
nodes  above  it,  and  a  is  a  normalization  constant  defined  as 

a=?(Dd(  a)  |  Du(  A) )  -1 .  P(AA)  is  in  fact  a  conditional  probability 
conditioned  on  the  existing  state  of  knowledge. 

Updating  the  values  of  g  and  q  at  every  node  in  the  light  of 
new  information  allows  for  the  calculation  of  the  probability  or 
likelihood  of  the  state  of  every  node.  The  calculation  of  g  at  a 


node  involves  only  data  obtained  from  the  network  rooted  at  that 
node.  The  data  obtained  from  the  network  rooted  at  A  is 
equivalent  to  data  obtained  from  each  of  the  networks  rooted  at 
nodes  adjacent  to  A.  This  says  that  g  can  be  calculated  at  a 
node  if  the  g's  of  the  nodes  immediately  below  it  and  the 
conditional  probabilities  quantifying  the  relation  between  these 
nodes  are  known. 

The  data  above  A,  DU(a)#  required  to  calculate  can  be 
decomposed  into  two  disjoint  sets:  DU(B)  and  (Siblings  of  A). 
Following  the  same  reasoning  as  just  used,  we  obtain  a  result 
that  enables  us  to  compute  P{Aj)  and  P(Bj)  without  requiring 
normalization.  These  results  indicate  that  Information  to 
perform  the  local  processing  can  be  represented  at  each  node  by 
assessed  conditional  probabilities  relating  adjacent  nodes  in  the 
hierarchy  and  computed  values  of  g  and  P(*)  at  each  node. 

To  initialize  the  Inference  net  for  propagation,  we  need  the 
assessed  conditional  probabilities  at  each  node.  At  an 
observational  node  every  state  is  equally  likely  to  occur  in  the 
absence  of  any  information,  hence  g(-)  is  set  to  1  at  every 
observational  node.  From  this,  the  value  of  g  at  every  other  node 
can  be  calculated.  From  the  prior  probability  at  the  top  node 
and  the  computed  values  of  g,  the  probability  of  the  states  of 
each  node  can  be  calculated.  Once  the  net  is  initialized,  the 
occurrence  of  a  particular  state  at  an  observational  node  will 
cause  g  to  be  updated.  This  Information  is  then  propagated  up  to 
update  the  g's  of  all  other  nodes  and  then  down  to  update  the 
likelihood  of  the  states  of  each  node. 

In  contrast  with  strict  Bayesian  procedures,  Pearl's  scheme 
requires  only  the  assessment  of  a  prior  probability  for  the  node 
at  the  top  of  the  hierarchy,  that  is,  the  last  stage  of  the 
hierarchical  inference  structure  usually  representing  the 
hypotheses  being  studied.  The  probabilities  of  all  other  stages 
in  the  structure  are  uniquely  determined  by  the  assessed 
conditional  probabilities  at  each  node,  thus  reducing  somewhat 
the  amount  and  complexity  of  prior  information  required.  On  the 
other  hand,  Pearl's  work  relies  on  more  strict  independence 
assumptions  in  order  to  obtain  computationally  tractable  results, 
and  also  requires  prior  knowledge  about  the  distribution  of  the 


underlying  hypothesis  being  studied. 

One  of  the  major  criticisms  of  this,  and  similar  Bayesian 
approaches,  is  the  need  to  identify  point  values  about  the 
probability  of  events.  Usually,  a  point  value  assessment  of  the 
probability  of  an  event  is  an  overstatement  about  our  actual 
knowledge  of  the  likelihood  of  occurrence  of  that  particular 
event.  In  response  to  the  need  of  representing  imprecision  of 
Bayesian  probability  values,  Dempster  [1967]  utilized  the  concept 
of  lower  and  upper  probabilities  to  deal  with  the  subjective 
imprecision  of  uncertainty  measures.  Shafer  [1976,  1981] 
presents  a  comprehensive  exposition  of  this  novel  idea  as  well  as 
extensions  to  the  theory  of  inference  based  on  the  concept  of 
upper  and  lower  probabilities.  The  basic  idea  of  this  concept  is 
that  instead  of  representing  the  probability  of  an  event  A  by  a 
point  value  P(A),  it  may  be  bounded  by  a  subinterval  of  [0,1]. 
That  is,  the  exact  probability  P(A)  may  be  unknown  but  bounded. 
This  kind  of  representation  has  solid  grounds  in  the  Dempster- 
Shafer  theory  of  basic  probability  and  for  that  reason  has 
received  considerable  attention  recently. 

Of  particular  interest  in  this  research  is  the  work  of 
Toulmin  et.  al.  [1979]  in  that  they  have  constructed  an  explicit 
structured  model  of  logical  reasoning  that  is  suited  for 
analytical  inquiry  and  computer  implementation.  The  model  is 
sufficiently  general  that  it  can  be  used  to  represent  logical 
reasoning  in  a  number  of  application  areas. 

Starting  from  the  assumption  that  whenever  we  make  a  claim 
there  must  be  some  grounds  in  which  to  base  our  conclusion, 
Toulmin  states  that  our  thoughts  are  generally  directed  from  the 
GROUNDS  to  the  CLAIM.  The  GROUNDS  and  the  CLAIM  are  statements 
that  express  fact  and  values.  As  a  means  of  stating  observed 
patterns  of  stating  a  claim,  there  must  be  a  reason  that  can  be 
identified  to  connect  the  GROUNDS  and  the  CLAIM.  This  connection 
is  called  the  WARRANT,  and  it  is  the  WARRANT  that  gives  to  the 
GROUNDS-CLAIM  connection  its  logical  validity. 

We  say  that  the  GROUNDS  support  the  CLAIM  on  the  basis  of 
the  existence  of  a  WARRANT  that  explain  the  connection  between 
the  grounds  and  the  claim.  It  is  easy  to  relate  the  structure  of 
this  basic  elements  with  the  process  of  inference,  whether 


statistical,  deductive,  or  inductive.  The  WARRANTS  are  the  set  of 
rules  of  inference,  and  the  GROUNDS  and  CLAIM  are  the  set  of  wel  1 
defined  propositions  or  hypotheses.  It  will  be  only  the  sequence 
and  procedures,  that  are  used  to  come  up  with  the  three  basic 
elements  and  their  structure  in  a  logical  fashion,  what  will 
determine  the  type  of  inference  that  is  used. 

Sometimes,  in  the  course  of  reasoning  about  an  issue,  it  is 
not  enough  that  the  WARRANT  will  be  the  absolute  reason  to 
believe  the  CLAIM  on  the  basis  of  the  GROUNDS.  For  that,  Toulmin 
allows  for  further  BACKING  which,  in  his  representation,  supports 
the  WARRANT.  It  is  the  BACKING  that  provides  for  the 
reliability,  in  terms  of  truth,  associated  with  the  use  of  the 
WARRANT.  The  relationship  here  is  analogous  to  the  way  in  which 
the  GROUNDS  support  the  CLAIM.  An  argument  will  be  valid  and  will 
give  the  CLAIM  solid  support  only  if  the  WARRANT  is  relied  upon 
and  is  relevant  to  the  particular  case  under  examination.  The 
concept  of  logical  validity  seems  to  imply  that  we  can  only  make 
a  CLAIM  when  both  the  WARRANT  and  the  GROUNDS  are  certain. 
However,  imprecision  and  uncertainty  in  the  form  of  exceptions  to 
the  rules  or  low  degree  of  certainty  in  both  the  GROUNDS  and  th« 
WARRANT  does  not  prevent  us  on  occasions  from  making  a  "hedge”  or 
a  vague  CLAIM.  Very  commonly,  we  must  arrive  at  conclusions  on 
the  basis  of  something  less  than  perfect  evidence;  and  we  put 
those  claims  forward  not  with  absolute  and  irrefutable  truth  but 
rather  with  some  doubt  or  degree  of  speculation. 

To  allow  for  these  cases,  Toulmin  adds  MODAL  QUALIFIERS  and 
POSSIBLE  REBUTTALS  to  his  framework  for  logical  reasoning.  MODAL 
QUALIFIERS  refer  to  the  strength  or  weakness  with  which  a  claim 
is  made.  In  essence  every  argument  has  a  certain  modality.  Its 
place  in  the  structure  presented  so  far  must  reflect  the 
generality  of  the  WARRANT  in  connecting  the  GROUNDS  to  the  CLAIM, 
and  also  with  condition  of  validity  of  the  set  of  facts  as 
GROUNDS.  POSSIBLE  REBUTTALS,  on  the  other  hand,  are  exceptions  to 
the  rules.  Although  MODAL  QUALIFIERS  serve  the  purpose  of 
weakening  or  strengthening  the  validity  of  a  CLAIM,  there  may  be 
still  conditions  that  Invalidate  either  the  GROUNDS  or  the 
WARRANTS,  and  this  will  result  in  deactivating  the  link  between 
the  CLAIM  and  the  GROUNDS.  These  cases  are  represented  by  the 


POSSIBLE  REBUTTALS. 

The  resulting  structure  of  logical  reasoning  provides  a  very 
useful  framework  for  the  study  of  human  Information  processing 
activities.  The  order  in  which  the  six  elements  of  logical 
reasoning  has  been  presented  serve  only  the  purpose  of 
illustrating  their  function  and  interdependence  in  the  structure 
of  an  argument  about  a  specific  Issue.  It  does  not  represent  any 
normative  pattern  of  argument  formation.  In  fact,  due  to  the 
dynamic  nature  of  human  reasoning,  the  concept  formation  and 
framing  that  results  in  a  particular  structure  may  occur  in 
different  ways.  The  six  element  model  of  logical  reasoning  is 
shown  in  Figure  1. 
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Figure  1.  The  six  element  model  of  logical  reasoning 

The  effects  of  various  forms  of  Inquiry  upon  Issues  of 
representation  and  detection  of  judgmental  errors  in  human 
information  processing  have  been  investigated  [Lagomaslno  and 
Sage  I985ab,  1986]  using  this  structure  of  rational  argument. 
The  frameworks  for  Bayesian  inference  just  discussed  requires 
probability  values  as  primary  Inputs.  Since  most  events  of 
Interest  are  unique  or  little  is  known  about  their  relative 
frequencies  of  occurrence,  the  assessments  of  probability  values 
usually  requi  is  human  judgment.  Substantial  psychological 
research  has  s' ^  n  that  people  are  unable  to  elicit  probability 
values  consistent  with  the  rules  of  probabilities  and  that  they 
are  suboptlmum  in  revising  probability  assessment  when  new 


Information  Is  obtained. 

Tversky  and  Kahneman  [1982]  have  shown  that  dominance  of 
causal  over  diagnostic  information  exists  in  assessing 
conditional  probabilities.  They  concluded,  in  a  series  of 
experiments,  that  if  some  information  have  both  causal  and 
diagnostic  implications  then  people.  Instead  of  weighting  the 
causal  and  diagnostic  impacts  of  the  evidence,  they  apparently 
assess  conditional  probabilities  primarily  in  terms  of  the  direct 
causal  effect  of  the  impacts.  Thus,  if  A  is  perceived  to  be  the 
cause  of  B,  people  will  give  higher  probabilities  to  P(B|A)  than 
to  P(A|B).  Burns  and  Pearl  [1981]  conducted  a  study  to  test  the 
validity  of  judgments  made  by  these  two  forms  of  reasoning.  Thus, 
they  investigated  whether  causal  or  diagnostic  judgment  is  a  more 
natural  way  of  encoding  knowledge  about  every  day  experiences. 
Their  results  demonstrated  that  neither  one  was  found  to  be  more 
accurate  than  the  other.  In  a  similar  study,  Moskowitz  and  Sarin 
[1983]  reported  that  individuals  found  it  easier  and  showed  more 
confidence  in  assessing  P(AjB)  if  B  is  causal  to  A. 

This  apparent  contradiction  of  results  may  be  explained  by 
the  differences  in  the  contingency  task  structure  within  which 
the  experiments  were  performed,  and  that  suggest  that  the  choice 
of  which  form  of  inference  to  invoke  depends  more  on  the  level  of 
familiarity  of  the  observer  with  the  task  at  hand  and  the 
cognitive  style  which  determines  the  way  in  which  the  knowledge 
was  originally  perceived.  Most  structuring  procedures  for 
decision  making  rely  on  the  ’’divide  and  conquer”  approach  under 
the  assumption  that  judgment  is  improved  when  a  complex,  ill- 
defined  problem  is  decomposed,  analyzed  and  solved  by  a  set  of 
smaller,  well-defined  problems.  The  findings  of  these  studies, 
aside  from  having  implications  on  the  validity  of  the  "divide  and 
conquer"  approach,  implies  that  the  form  of  representation  of 
judgments  used  should  correspond  with  the  meaning  of  the 
judgments  assessed. 

Falk  and  Bar-Hillel,  [1979]  have  recognized  the  importance 
of  distinguishing  between  probabilistic  and  logical  support. 
Probabilistic  support  refers  to  the  increased  in  likelihood  of 
the  occurrence  of  an  event  A  given  that  another  event  B  has 
occurred.  That  is,  A  supports  B  if  P(B|A)>P(B).  Logical  support 


exhibits  the  relation  of  implication  between  two  premises, 
denoted  A->B,  that  fails  to  hold  only  if  the  first  is  true  and 
the  second  is  false.  Logical  support  is  transitive;  if  A->B  and 
B->C,  then  A_>C.  When  A->B  it  is  also  true  that  B->A*  With  these 
definitions,  the  distinctions  between  probabilistic  and  logical 
support  should  be  apparent.  Logical  support  (ATB)  does  not  imply 
conditions  similar  to  those  that  follow  from  probabilistic 
support.  A->B  is  logically  equivalent  to  B->A,  but  does  not  say 
anything  about  the  truth  of  A->B  or  B->A.  Likewise,  probabilistic 
support  is  not  transitive  and  logical  support  must  be  transitive. 
A  major  point  in  this  distinction  that  arises  here  is  when  to 
apply  these  two  methods  of  representation  in  inferential 
activities.  We  are  concerned  with  this  issue  because,  as  previous 
research  has  shown,  the  method  used  to  represent  human  judgments 
may  strongly  influence  the  validity  and  consistency  of  these 
judgments . 

It  is  especially  important  here  to  note  that  we  can  ascribe 
uncertainty  to  the  truth  of  logical  support  by  referring  to  the 
probability  by  which  A  implies  B,  P{A->B).  The  importance  of  this 
will  concern  us  next  in  the  development  of  a  general  framework 
for  inference.  Much  of  our  research  has  been  concerned  with 
developing  a  framework  of  inference  suitable  for  assessing  and 
structuring  complex  problems  that  derives  from  the  logic  of 
reasoning  of  Toulmin  and  the  calculus  of  probabilities  to  make 
inferences  on  the  likelihood  of  the  events  or  premises  that 
comprise  the  inference  structure.  Assessments  by  the  decision 
maker  in  the  form  of  logical  support  relations  among  the  events 
are  used  to  structure  the  problem,  and  assessments  in  the  form  of 
set  inclusion  inequalities  among  the  events  and  their  relations 
are  combined  using  the  probability  calculus  to  draw  inferences. 

The  framework  and  process  for  inference  support  developed 
here  is  applicable  to  a  general  class  of  networks  of  interrelated 
propositions.  Specifically,  it  can  be  applied  to  finite 
connected  networks  where  the  number  of  propositions  is  finite  and 
where  every  pair  of  distinct  propositions  is  joined  by  at  least 
one  chain  of  relations.  We  have  developed  a  procedure  that 
describes  the  information  processing  elements  involved  in  the 
structuring  and  analysis  of  an  issue  within  this  framework.  The 
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information  processing  functions  associated  with  the  use  of  the 
framework  for  inference  described  here  involves  four  steps: 

1)  initial  problem  framing, 

2)  hypothesis  generation,, 

3)  parameter  value  assessment,  and 

4)  hypothesis  evaluation  and  situation  assessment. 

The  intent  of  the  first  step  is  to  capture  those  elements 
and  relations  that  constitute  an  issue,  and  to  represent  them  in 
a  form  that  is  suitable  for  inference.  The  inference  network 
developed  here  are  not  necessarily  hierarchical  as  contrasted 
with  the  case  of  Bayesian  inference.  We  are  able  to  deal  with 
structures  that  correspond  to  a  very  general  type  of  inference 
network.  Nodes  in  the  network  represent  the  propositions  of 
interest  in  the  particular  issue.  Inferential  links  between 
propositions  are  defined  in  terms  of  the  set  of  consistency 
relational  equations,  including  the  set  of  consistency  relations 
and  any  other  assessed  relations  between  the  propositions  at  each 
node.  The  probability  value  of  the  propositions  at  each  node  is 
underconstrained  and  acquisition  of  information  about  the 
relation  between  the  nodes  is  the  primary  means  of  further 
constraining  the  probability  values  of  the  propositions  at  each 
node . 

Given  the  assessed  initial  problem  frame,  the  task  of 
hypothesis  generation  involves  the  generation  of  reasonable 
hypotheses  that  are  based  on  situational  perception  and 
information  needed  for  the  task  at  hand.  In  most  cases  this 
involves  the  specification  of  alternative  hypotheses  at  each 
node.  Ideally,  the  set  of  hypotheses  under  consideration  at  each 
node  should  be  mutually  exclusive  and  exhaustive.  This  task  also 
involves  the  selection  of  the  basic  premises  and  possible 
rebuttals  relevant  for  each  inferential  link. 

The  parameter  value  identification  step  provides  for  the 
continual  assessment  of  the  parameters  of  the  inference  model. 
This  includes  the  assessment  of  probability  values  of  the 
propositions  at  each  node  as  well  as  the  probability  values 
representing  the  uncertain  logical  relations  at  each  inferential 
link.  These  assessments  can  be  related  and  represented 
Imprecisely  in  the  form  of  bounded  intervals  and/or  linear 
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inequalities  on  the  set  of  parameters.  Achieving  the  task  of 
parameter  value  assessment  with  minimal  imprecision  will  depend 
strongly  on  the  quality  of  the  information  available  and  the 
person's  perception  and  familiarity  with  the  task  at  hand. 

The  hypothesis  evaluation  and  situation  assessment  step 
involves  probability  categorization,  over  a  set  of  alternative 
hypotheses,  of  the  probable  situations  as  captured  by  the 
information  that  is  provided  to  the  inference  model.  Given  the 
set  of  consistency  relational  equations  for  each  link  in  the 
inference  network,  we  can  calculate  the  probability  values  for 
the  propositions  at  each  node.  These  probability  values  will 
usually  be  stated  in  the  form  of  bounded  intervals  and  linear 
inequalities.  If  more  precise  information  is  required  the:, 
further  assessments  about  the  relations  and  propositions  in  the 
network  must  be  performed.  This  suggests  the  generation  of 
alternative  hypotheses  and  the  assessment  of  more  precise 
parameter  values.  The  information  processing  tasks  required  in 
the  use  of  the  framework  for  inference  based  on  logical  reasoning 
describes  an  iterative  process  suitable  for  situations  where 
knowledge  about  it  is  ill  defined  or  imperfectly  described. 

The  objective  of  this  portion  of  our  research  has  been  to 
investigate  various  approaches  for  inference  based  on  imprecise 
knowledge,  and  to  advance  the  state  of  research  in  the  area  of 
representation  of  natural  language  expressions  about  uncertainty 
and  imprecision.  We  have  investigated  a  new  approach  for 
inference  based  on  logical  support  relations  that  differs 
considerably  from  Bayesian  approaches  which  rely  on  probabilistic 
support  relations.  This  new  approach  has  the  interesting  feature 
of  being  computationally  simple,  capable  of  working  in  a  general 
class  of  inference  networks,  not  relying  on  idealistic 
Independence  assumptions,  and  not  having  to  make  a  clear 
distinction  between  hypothetical  and  evidential  type  of 
information. 

6.  Effectiveness  Issues  and  Conclusions 

In  the  context  of  devices  to  aid  in  human  information 
processing  activities,  there  exist  two  design  philosophies 
concerning  the  proper  relationship  between  the  input  component 
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and  the  generalizing  or  inference  mechanism.  One  advocates  the 
view  that  these  components  should  be  considered  as  operating 
separately;  with  the  input  component  in  charge  of  knowledge 
acquisition  and  representation  considered  as  if  it  was 
independent  of  the  generalizing  sector  which  is  in  charge  of 
aggregation  or  inference.  This  approach  offers  simplicity  in 
system  design,  at  the  expense  of  effectiveness.  The  mode  of 
representation  of  information  will  influence  the  success  r . 
failure  of  the  inquirer  in  arriving  at  a  solution.  This 
deficiency  seems  to  be  characteristic  of  many  current  information 
systems.  They  are  passive  and  it  is  up  to  the  user  to  recognize 
an  information  need  and  then  seek  out  the  required  information. 

The  other  approach  considers  that  the  two  sectors  are 
essentially  nonseparable  and  that  each  supports  and  enhances  the 
functioning  of  the  other;  but  this  in  turns  complicates  the 
system  design,  perhaps  by  a  considerable  amount.  In  this 
approach,  the  internal  interactions  of  the  input  and 
generalizing  sector  are  capable  of  generating  user-system 
interaction.  There  are  various  ways  in  which  a  system  can 
initiate  a  dialog  with  a  user.  These  include  identification  of: 

(1)  "gaps"  in  the  knowledge  base  that  prevent  the  system 
from  making  inferences,  or  from  adequately  summarizing 
the  information  in  a  sector  of  the  knowledge  base; 

(2)  an  inconsistent  set  of  information  followed  by 
detection  of  the  inability  of  the  system  to 
resolve  it;  or 

(3)  sufficiently  imprecise  information  that  makes  it  not 
possible  to  suggest  an  appropriate  course  of  action; 
and 

(4)  inability  of  the  system  to  satisfy  the  desired  goals  of 
the  user. 

Identification  of  these  potential  deficiencies,  and  use  of 
prompts  based  on  them  for  purpose  of  computer-control  dialog  are 
needs  in  intelligent  system  design  for  decision  support.  To  be 
fully  responsive  to  the  needs  of  users  research  concerning  this 
should  be  integrated  with  research  involving  inference 
structures . 

In  this  paper  and  in  the  associated  research,  we  have  been 
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especially  concerned  with  situations  in  which  there  are  a  variety 
of  perspectives  and  experiential  familiarity  with  a  particular 
judgmental  task.  It  is  argued  that  this  requires  attention  to 
combining  the  skill  based  and  rule  based  features  of  an  expert 
system  with  the  formal  reasoning  based  knowledge  developed 
through  use  of  a  decision  support  system.  This  could  be 
pcnorj  a i  i  y  fruitful  in  accomplish  meta-level  mcdsl  based 
management.  A  structured  inference  procedure  to  accomplish  this 
type  of  control,  based  on  the  use  of  imperfect  information  as 
well  as  probabilistic  and  logical  support,  was  described. 
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